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Abstract 

The traditional “black box” approach to evaluation of assignments in educational 
research courses has at least two effects: 1) products that fail to meet the expectations of 
the instructor and 2) frustration on the part of students who do not know exactly what is 
expected and who are consequently confused about or disappointed in the grades they 
receive. Solutions to this problem include developing checklists and rubrics which break 
complex tasks, such as writing research proposals and masters’ theses, into component 
parts, using the checklists and rubrics to guide students’ work, and then grading the 
students on how well they complete each component. 

Included in the appendix are sample checklists for scoring content, quality of 
writing, and adherence to APA style in research proposals, as well as rubrics for masters’ 
theses and group research project presentations. 
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IMPROVING ACHIEVEMENT AND STUDENT SATISFACTION THROUGH 
CRITERIA-BASED EVALUATION: CHECKLISTS AND RUBRICS IN 
EDUCATIONAL RESEARCH CLASSROOMS 
The traditional “black box” approach to evaluation of assignments in educational 
research courses has at least two effects: 1) products that fail to meet the expectations of 
the instructor and 2) frustration on the part of students who do not know exactly what is 
expected of them and who are consequently confused about or disappointed in the grades 
they receive. Instructors can use scoring guides to share their expectations and to guide 
students in the processes of research, writing, and developing presentations; the guides 
can be used by students to direct their own work, assess their own achievement, and 
improve the quality of their work before the project is graded by the instructor. The 
“black box” is removed, revealing a not-too-mysterious collection of component parts, 
each well described and responsible for a portion of the total grade. 

A scoring guide, as presented here, can take two forms: a structured checklist in 
which positive achievement of each of the components of the project is described, and a 
five-point scale is provided to rate agreement from strongly disagree to strongly agree; 
and a rubric, in which components of the project are listed, and standards of performance 
from low to high for each of the components are described. Included in the appendix are 
sample checklists for scoring content, quality of writing, and adherence to APA style in 
research proposals, as well as rubrics for masters’ theses and group research project 
presentations. 

According to Mabry (1999), scoring guides “are translations of visions of 
desirable performance into specifications of exactly what is desirable.” They “specify 
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both what students should know and how well they should perform” (p. 674). They can 
be analytical or holistic (Luft, 1997; Tuttle, 1996). An analytical rubric “breaks the 
project into its many important parts and rates each part on a scale,” whereas a holistic 
rubric “rates a few skills without doing a microscopic analysis” (Tuttle, 1996, p. 3 1). The 
scoring guides included in the appendix are analytical. 

Constructing a scoring guide involves enumerating the elements of the project 
that need to be assessed and determining and describing the elements of performance 
(Luft, 1997; Schack, 1994). Enumerating the elements of the project requires teachers to 
analyze their teaching/leaming objectives in great detail. Shaffner (1997) states, “With 
each rubric I prepared, I came to learn more intimately exactly what I was teaching and 
what I expected my students to accomplish (p. 262). Scoring guides should be seen as 
always “in progress.” As instructors evaluate projects against established guides, they 
will inevitably adjust the criteria to enable students to produce even better products in the 
future. 

Some instructors involve students in the development of scoring guides. 

According to Lundberg (1997), “students are more comfortable and realize their opinion 

is valued They are more successful because they know what is expected, and most are 

willing to work to meet those expectations” (p. 53). Students, as well as instructors, are 
more aware of the essential elements of the required assignments. 

Schack (1994) advocates providing models, or “benchmarks,” for various levels 
of performances. Such models should be used for instruction as well as for justification of 
grades. 
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Use of scoring guides involves extended interaction between teacher and 
student. According to Tuttle (1996), “the purpose of having a rubric is to be sure that 
both the student and the teacher understand and agree upon how the project will be 
evaluated” (p. 30). Jensen (1995) goes further in stating that with a rubric students not 
only know the outcome of the assessment, they also can “set goals toward the completion 
of the task” (p. 35). The assessment plan should help students “guide their work along 
the way” (Schack, 1994, p. 39), assisting in the process of completion of the project, not 
only in its scoring. Falk and Ort (1998) state that working with students in projects that 
have scoring guides helps teachers “understand the strategies and approaches students 
bring to their learning” (p. 62). The use of scoring guides thus focuses discussion 
between teacher and students, giving them a common purpose and a commonly- 
understood goal. Students are required to be self-directed, reflective learners, using the 
scoring guides to assess and improve their work. 

A criticism of the use of scoring guides is that they can “set the boundaries of 
creative expression” (Mabry, 1999, p. 678). However, the projects assigned in 
educational research classrooms generally follow established formulas, and papers and 
presentations are often scored on specified criteria. Points can be allocated to emphasize 
some components of the project, such as integrity of research design, while de- 
emphasizing others, such as mechanics. Care can be taken as well to encourage students 
to see the scoring guides, especially rubrics, as setting the floor but not defining the 
ceiling. 

In summary, scoring guides such as structured checklists and rubrics can be used 
in educational research classrooms to improve instruction and reduce student frustration. 
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They force instructors, and sometimes students, to delineate the important elements of 
each research assignment, and to describe the ideal. With the goal in mind, students can 
more comfortably determine the path they choose, and instructors can more successfully 
guide them along that path. In our experience, the use of scoring guides has resulted in 
quantum leaps in the quality of student output. And as the structure and use of our guides 
continues to improve, so do our students’ work and their satisfaction with it — and us. 




7 



Checklists and Rubrics 7 



References 

Falk, B., & Ort, S. (1998). Sitting down to score: Teacher learning through 
assessment. Phi Delta Kappan. 80(1), 59-64. 

Jensen, K. ((1995). Effective rubric design. The Science Teacher. 62(5), 34-37. 
Luft, J. (1997). Design your own rubric. Science Scope. 20(5). 25-27. 

Lundberg, R. (1997). Student-generated assessment. The Science Teacher. 

M(l), 50-53. 

Mabry, L. (1999). Writing to the rubric: Lingering effects of traditional 
standardized testing on direct writing assessment. Phi Delta Kappan. 80(9), 673-679. 

Schack, G. D. (1994). Authentic assessment procedures for secondary students’ 
original research. The Journal of Secondary Gifted Education. 6(1), 38-43. 

Shaffner, A. (1997). Rubrics in middle school: Rewarding or rueful. Teaching and 
Change. 4(3), 258-283. 

Tuttle, H. G. (1996). Rubrics: Keys to improving multimedia presentations. 
Multi-Media Schools. 3(1), 30-33. 




SCORING CHECKLIST FOR CONTENT IN RESEARCH ARTICLE PROPOSALS 



Tony Onwuezbuzie — RSCH 7100 



Name(s) : 

Semester: Date: 



DIRECTIONS : 

For each of the following statements, indicate the extent to which you agree or disagree to the corresponding 
ratings of students, according to the scale below. (Note: Any statements which are not applicable will 
automatically receive a Astrongly agrees rating.) 

l=strongly disagree 2=disagree 3==neutral 4=agree 5=strongly agree 

CONTENT 



Title: 



1 . The title makes clear the population of interest. 1 

2. The title makes clear the primary independent variable(s). i 

3. The title makes clear the dependent variable(s). i 

4. The title indicates the specific relationship between the 

major variables. l 

5. Vague, ambiguous, and emotional-laden terms have been avoided. l 



Summary 



6. The rationale of the study is presented clearly. l 

7. The purpose of study is provided adequately. l 

8. The research questions and/or hypotheses are presented adequately. i 

9. The educational significance is delineated explicitly and clearly. l 

10. The sample size and/or group sizes are specified. l 

1 1 . The major characteristics of the sample are delineated adequately. i 

12. The instrument(s) used are specified and/or described adequately. l 

13. The research design used is identified. l 

14. Procedures are described adequately. l 

15. The method of data analysis is described clearly. l 

16. It is specified clearly how and to whom the findings of the study will be 

delineated. l 



2 

2 

2 

2 

2 



2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 



3 4 5 
3 4 5 
3 4 5 

3 4 5 
3 4 5 



3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 
3 4 5 

3 4 5 
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Introduction/Literature Review: 

17 There is an explicit statement of the problem. 1 

18. The statement of the problem is stated in the opening paragraph. 1 

19 Adequate background information is given on the problem presented. i 

20. Every statement of fact is supported by one or more citations. l 

21 . All findings from previous research are supported by one or more citations, l 

22. The literature review is comprehensive. l 

23. All references cited are relevant to the problem under investigation. l 

24. Most of the sources are primary. i 

25. Most of the references are current. l 

26. The review explicitly relates previous studies to the problem. i 

27. At least some of the references have been critically analyzed. i 

28. The references have been compared and contrasted adequately. i 

29. The review logically flows in such a way that the references least 
related to the problem are discussed first and the most related 

references are discussed last. i 

30. Clear connections are made between the present study and the 

previous research. i 

3 1 . All theoretical terms and concepts are directly/operationally defined. i 

32. A clear theoretical framework is presented. i 

33. The review concludes with a brief summary. l 

34. A clear rationale for the study is provided. l 

35. There is an explicit purpose statement. l 

36. The purpose statement flows logically from the rationale. i 

37. The purpose statement makes clear the population of interest. i 

38. The purpose statement makes clear the primary independent variable. i 

39. The purpose statement makes clear the primary dependent variable. l 

40. The purpose statement indicates the specific relationship between 

the major variables. i 

41 The purpose statement is consistent with the title. T 

42. The research problem is researchable. i 

43. One or more explicit research questions are presented. i 

44. The research questions follow the purpose statement. i 

45. Each research question makes clear the population of interest. i 

46. Each research question makes clear the primary independent variable. i 

47. Each research question makes clear the primary dependent variable. i 

48. Each hypothesis is stated clearly and concisely. l 

49. Each hypothesis states the expected relationship or difference. i 

50. Each hypothesis makes clear the population of interest. i 

5 1 . Each hypothesis makes clear the primary independent variable. i 

52. Each hypothesis makes clear the primary dependent variable. i 

53. Each hypothesis logically flows from the literature review. i 

54. Each hypothesis logically flows from the theoretical framework. i 

55. Each hypothesis is testable. i 

56. The educational significance is stated explicitly. i 

O 2 
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Method 



Subjects 

57 . The (approximate) population size is provided. 12345 

58 . The major characteristics of the population are described adequately. 12345 

59 . The selection-eligibility criteria are described adequately. 12345 

60 . If a sample will be selected, the sampling scheme is described clearly. 12345 

61 . The use of volunteers was avoided. 12345 

62 . The sample size is provided'. 12345 

63 . The sample size is adequate for the research design. 1 234 5 

64 . The major characteristics of the sample are described adequately. 12345 

65 . Evidence of ethical considerations is provided adequately. 12345 

Instruments 

66 . An adequate rationale is given for the selection of each instrument. 1 2 3 4 5 

67 . Each instrument is described adequately in terms of purpose and content. 12345 

68 . The developers of all instruments are specified clearly. 12345 

69 . The format of the items is specified clearly and accurately. 12345 

70 . The administration, scoring or tabulating, and interpretation. 

procedures are fully described. 12345 

71 . Citations are presented for any information provided pertaining to the 

development of all instruments (e.g., standardization/norming techniques). 12345 

72 . Citations are provided for all statements of facts and research findings 

pertaining to the characteristics of the instruments. 12345 

73 . Each instrument appears to be appropriate for measuring the intended 

variables. 12345 

74 . Evidence is given that each instrument is appropriate for the sample. 12345 

75 . Each instrument appears to be appropriate for the sample under study. 12345 

76 . Information is provided which indicates that administrators, 

observers, or interviewers are/will be well trained. 1 2 3 4 5 

77 . Adequate information is provided which indicates that there is no 

administrator, observer, or interviewer effect. 1 2 3 4 5 

78 . Instrument reliability is described adequately in terms of type of coefficients 1 2345 

79 . Instrument reliability is described adequately in terms of size of coefficients. 12345 

80 . If appropriate, subtest reliabilities are provided adequately. 12345 

8 1 . All instruments used appear to be sufficiently reliable. 12345 

82 . Instrument validity is discussed and coefficients given if appropriate. 12345 

83 . Citations are provided for all reliability and validity coefficients presented. 1 2 3 4 5 

84 Each instrument is described in terms of content-related validity. 12345 

85 . Each instrument is described in terms of criterion-related validity. 12345 

86 . Each instrument is described in terms of construct-related validity. 12345 

87 . All instruments used appear to be sufficiently valid for the study. 1 2 3 4 5 

88 . If an instrument was/will be designed specifically for the study, the 
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procedures involved in its development are described. 1 

89. If an instrument was/will be designed specifically for the study, the 

procedures involved in its validation are described. 1 

90. If an instrument was/will be designed specifically for the study, the 
administration, scoring or tabulating, and interpretation procedures 

are fully described. 1 

Procedure 



91. All data collecting procedures are clearly described. i 

92. The study will be conducted for an appropriate length of time 

for the predicted outcomes to be observed. i 

93. The training of data collectors is clearly described and adequate. i 

94. It appears that the data collection procedure will be conducted in 

a consistent manner. i 

95. The ethical nature of data collection method is discussed adequately. i 

96. Procedures are described in sufficient detail to permit replication. i 

97. Citations are provided for any procedural information delineated which 

are directly or indirectly based on previous research. i 

98. If a pilot study will be conducted, its execution and results are 

described as well as its impact on the subsequent study. i 

99. The procedures provide sufficient control for internal validity. i 

100. The procedures provide sufficient control for external validity. i 

101. The research paradigm used is clear. i 

102. The research design is stated clearly. i 

1 03 . Adequate justification is provided for the research design used. l 

104. The design appears to be appropriate for answering the research study or 

testing the hypothesis. i 

105. If groups will be compared, it is clear whether subjects will be randomly 

assigned to groups. i 

106. If groups will be compared, the number of subjects in each group 

is stated. i 

107. If groups will be compared, the number of subjects per group used 
appears to be adequate, or else an appropriate rationale is provided as to 

why the group sizes are smaller than recommended. i 

108. If groups will be compared, it is clear whether subjects will be blinded 

as to what treatment group they will be assigned. i 

109. If groups will be compared, it is clear whether the individual measuring the 

outcome variable(s) will be blinded to the treatment group which the 
subject will be assigned. i 

1 10. If groups will be compared and subjects will be aware of their group 
assignment, it is clear that this knowledge will not affect their responses. i 

1 1 1 . If groups will be compared and the individual measuring the outcome 
variable will not be blinded, it is clear that the measurements 
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will not be biased by this. 1 

1 12. If groups will be compared, the conditions of all experimental groups are 

described clearly and completely. i 

1 13. If groups will be compared, the conditions of all control groups are 

described clearly and completely. l 

1 14. If groups will be compared, subjects in all groups will receive the exact 
same experimental procedures and measurements, except for the 

treatment intervention. l 

1 15. If groups will be compared, it is clear that there will be strict adherence 

to the protocol in all groups. l 

1 16. If groups will be compared, any subject attrition is described clearly. i 

1 17. It is specified clearly how and to whom the findings will be delineated. i 

Limitations 

1 1 8. At least two possible threats to internal validity are discussed adequately. i 

1 19. At least two possible threats to external validity are discussed adequately. i 

120. Each threat to internal validity discussed is labeled appropriately. l 

121. Each threat to external validity discussed is labeled appropriately. l 

122. Citations are provided when referring to threats to validity. l 

123. Discussion as to how to minimize each threat to internal validity 

is adequate. i 

124. Discussion as to how to minimize each threat to external validity 

is adequate. i 

125. All important threats to internal validity are discussed. l 

126. All important threats to external validity are discussed. l 



Analysis 

127. An adequate description is provided as to the analysis intended to 

address the research question(s) and/or test the hypotheses. l 

128. The method of analysis is appropriate for testing the research hypothesis. l 

129. The significance level of the statistical tests is delineated. l 



Appendix 



130. The appendix section contains samples of any researcher-made instruments, l 

131. All researcher-made instruments appear to be appropriate for the study. l 

132. The appendix section contains a timetable. l 

133. The timetable is clearly presented. l 

134. The timetable is consistent with information given in the procedure section, l 

135. The appendix section contains a budget. l 

136. The budget contains all important elements. l 
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137 . The budget is itemized appropriately. i 2 

138 . The budget does not contain any inappropriate items. 1 2 

139 . The budget appears appropriate for the study proposed. 1 2 

140 . The appendix section contains an appropriate number of informed consent 

forms. 1 2 

141 . Each informed consent form is written appropriately for the intended reader. 1 2 

142 . Each informed consent form contains all important information. 1 2 

143 . The information provided in each informed consent form is consistent 

with the information provided in the methods section. 1 2 

144 . The appendix contains biographical information of all authors. 1 2 

145 . The biographical information provided is appropriate. 1 2 
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Number of Occurrences: 



Number of points assigned 



TOTAL SCORE FOR RESEARCH PROPOSAL OUT OF 725: 

PERCENTAGE SCORE FOR RESEARCH PROPOSAL: 

RUBRIC EQUIVALENT SCORE OUT OF 60: 
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Research Proposal Scoring Checklist for Quality of Writing and Adherence to APA Style 

Tony Onwuegbuzie — RSCH 7100 



Name(s) : 

Semester: Date: 



DIRECTIONS : 

For each of the following statements, indicate the extent to which you agree or disagree, according to the scale 
below. (Note: Any statements which are not applicable will automatically receive a Astrongly agree 0 rating). 

l=strongly disagree 2=disagree 3=neutral 4=agree 5=strongly agree 



Title Page 

1. The title page contains all essential components. 

2. The page header adheres strictly to APA guidelines. 

3. The page header text is of high quality (e.g., grammar, punctuation). 

4. The running head adheres strictly to APA guidelines. 

5. The running head text is of high quality (e.g., grammar, punctuation). 

6. The title adheres strictly to APA guidelines (including margins). 

7. The title text is of high quality (e.g., grammar, punctuation). 

8. The names of all authors adhere strictly to APA guidelines. 

9. The names of all authors are spelled correctly. 

10. The affiliations adhere strictly to APA guidelines. 



i 

l 

i 

i 

i 

l 

i 

i 

i 

i 
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2 
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2 

2 

2 

2 

2 

2 

2 
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4 
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4 
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4 
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5 

5 

5 

5 

5 

5 

5 

5 

5 



Biographical Information 

1 . The biographies contain all the salient information. 

2. All information presented in the biographies is appropriate. 

3. All biographies are informative. 

4. All biographies are comprehensive. 

5. All biographies are written in strict adherence to APA guidelines 
(including margins). 

6. All biographies are clearly written throughout. 

7. The writing in the biography section is of high quality 
(e.g., grammar, punctuation). 



1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 . 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 
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Abstract/Summarv 

1. The summary contains all the salient information. 1 

2. No inappropriate information is presented in the summary 

(including repetitive information). i 

3. The summary is informative. i 

4. The summary is an accurate reflection of the research proposal. i 

5. The summary is comprehensive. i 

6. The summary is written in strict adherence to APA guidelines 

(including margins). i 

7. The summary is clearly written throughout. i 



8. The writing in the summary is of high quality (e.g., grammar, punctuation). i 

Introduction/Literature Review 



1. This section of the proposal contains all the salient information. l 

2. No inappropriate information is presented in this section of the proposal 

(including repetitive information). i 

3. This section of the proposal is informative. l 

4. This section of the proposal is entirely accurate. l 

5. This section of the proposal is comprehensive. i 

6. This section of the proposal is written in strict adherence to APA guidelines, 

(including margins) l 

7. This section of the proposal is clearly written throughout. l 

8. The writing in this section of the proposal is of high quality 

(e.g., grammar, punctuation). l 



Method 

Subjects 



1. This section of the proposal contains all the salient information. l 

2. No inappropriate information is presented in this section of the proposal 

(including repetitive information). l 

3. This section of the proposal is informative. l 

4. This section of the proposal is entirely accurate. l 

5. This section of the proposal is comprehensive. l 

6. This section of the proposal is written in strict adherence to APA guidelines, 

(including margins) l 

7. This section of the proposal is clearly written throughout. l 

8. The writing in this section of the proposal is of high quality 

(e.g., grammar, punctuation). l 

Instruments : 

1. This section of the proposal contains all the salient information. l 

2. No inappropriate information is presented in this section of the proposal 

(including repetitive information). i 

3. This section of the proposal is informative. i 
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4. This section of the proposal is entirely accurate. 1 

5. This section of the proposal is comprehensive. 1 

6. This section of the proposal is written in strict adherence to APA guidelines. 

(including margins) i 

7. This section of the proposal is clearly written throughout. i 

8. The writing in this section of the proposal is of high quality 

(e.g., grammar, punctuation). i 

Procedure: 

1 . This section of the proposal contains all the salient information. l 

2. No inappropriate information is presented in this section of the proposal 

(including repetitive information). l 

3. This section of the proposal is informative. l 

4. This section of the proposal is entirely accurate. i 

5. This section of the proposal is comprehensive. i 

6. This section of the proposal is written in strict adherence to APA guidelines, 

(including margins) l 

7. This section of the proposal is clearly written throughout. i 

8. The writing in this section of the proposal is of high quality 

(e.g., grammar, punctuation). i 

IAmitatignsi 

1 . This section of the proposal contains all the salient information. l 

2. No inappropriate information is presented in this section of the proposal 

(including repetitive information). l 

3. This section of the proposal is informative. l 

4. This section of the proposal is entirely accurate. l 

5. This section of the proposal is comprehensive. l 

6. This section of the proposal is written in strict adherence to APA guidelines. 

(including margins) l 

7. This section of the proposal is clearly written throughout. l 

8. The writing in this section of the proposal is of high quality 

(e.g., grammar, punctuation). l 



A nalysis^ 

1 . This section of the proposal contains all the salient information. l 

2. No inappropriate information is presented in this section of the proposal 

(including repetitive information). l 

3. This section of the proposal is informative. l 

4. This section of the proposal is entirely accurate. l 

5. This section of the proposal is comprehensive. l 

6. This section of the proposal is written in strict adherence to APA guidelines, 

(including margins) i 

7. This section of the proposal is clearly written throughout. l 
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8 . The writing in this section of the proposal is of high quality 
(e.g., grammar, punctuation). 



1 2 3 4 5 



Reference List 



1 . All citations provided in the text are contained in the reference list. i 2 

2 . All citations provided in the reference list are contained in the text. 1 2 

3 . The names of all authors provided in the text are consistent with 

the names presented in the reference list. 1 2 

4 . All authors are presented in strict adherence to APA guidelines. 1 2 

5 . All titles are written accurately and in strict adherence to APA guidelines. 1 2 

6 . Ali publication dates in the reference list are consistent with those 
in the text and are written in strict adherence to APA guidelines. 

(including margins) 1 2 

7 . All sources are written accurately and in strict adherence to APA guidelines. 1 2 

8 . Every aspect of the reference list strictly adheres to APA guidelines. 

(including margins) 1 2 



3 

3 

3 

3 

3 



3 

3 
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4 
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4 
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4 

4 
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5 

5 
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5 



5 

5 

5 



A ppendix 



1 . This section of the proposal contains all the salient information. 1 2 

2 . All information presented in this section of the proposal is appropriate. 1 2 

3 . This section of the proposal is informative. 1 2 

4 . This section of the proposal is entirely accurate. 1 2 

5 . This section of the proposal is comprehensive. 1 2 

6 . This section of the proposal is written in strict adherence to APA guidelines. 

(including margins) 1 2 

7 . This, section of the proposal is clearly written throughout. 1 2 

8 . The writing in this section of the proposal is of high quality 

(e.g., grammar, punctuation). 1 2 



345 

345 

345 

345 

345 

345 

345 

345 



Number of Occurrences: 



Number of points assigned 



Total Score out of 445: 



Percentage Score: 



Rubric Equivalent Score out of 40: 







4 



18 



EVALUATION FORM FOR PRESENTATIONS 
OF RESEARCH PROPOSALS 
RSCH 7100 



Names: 



Scoring Key: Strongly Disagree = SD; Disagree = D; Not Observed = N; Agree = A; and, Strongly Agree = SA. 



Content (3.5 points) 



SD D N A SA 



The introduction provided a substantial link from the audience's 
current knowledge to the presentation content. 

The importance of the topic was made clear. 

Links to the audience's knowledge were made throughout the 
body of the presentation. 

The presenters covered important concepts, research findings, 
researchers, and methodological issues in the field. 

The critique provided of current research reflected the expected 
level of research sophistication for students at this level. 

Clear citations of major articles were provided for the audience. 

Questions by the audience were handled appropriately, professionally, 
and reflected knowledge and understanding of the area. 

Comments: 



1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 



Organization (2.5 points) 



SD D N A SA 



The purpose of the presentation was stated clearly. 

The introduction clearly laid out an outline of the organization to follow. 

The important points were presented lucidly. 

Transitions between points made sense and aided the audience in 
following the arguments presented. 

A concise conclusion occurred, providing a sense of closure. 



1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 



Comments: 



Evaluation Form EDR701 (cont.) 

Scoring Key: Strongly Disagree = SD; Disagree = D; Not Observed = N; Agree = A; and, Strongly Agree = SA. 



Planning and Style (4 points) SD D I s 

The presentation in its entirely fit the allocated time. 1 2 3 

Visual aids (chalkboard, transparencies, handouts, PowerPoint, 
computer, video) were effective in their communication of information 

to the audience. 12 3 

Visual aids used were appropriate for the presentation. 1 2 3 

Visual aids used could be easily seen by all members of the audience. 1 2 3 

The body language (eye contact, use of gestures, posture, etc.) of presenters 

facilitated communication. 1 2 3 

The verbal presentation communicated excitement and confidence. 1 2 3 

The presenters used examples, understandable to the audience, to illustrate 

concepts, especially ones that might be unfamiliar. 12 3 

The demeanor of the presenters was appropriate for the setting. 1 2 3 

Comments: 



Points for Content 
Points for Organization 
Points for Planning and Style 



Total Points (Out of 100 possible) 




A SA 
4 5 

4 5 
4 5 
4 5 

4 5 
4 5 

4 5 
4 5 
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Muskingum College 
EDUC 700/701 
Research Project Rubric 



Score 


1 


3 


5 


Length 


Less than 20 pages 


20 to 30 pages 


More than 30 pages 


Chapter 1 


Mismatch between 
problem and research 
questions/ 
hypotheses 


Some relationship 
between problem and 
research questions/ 
hypotheses 


Clear relationship 
between problem and 
research questions/ 
hypotheses 




Superficial treatment of 
problem 


Adequate treatment of 
problem; no obvious 
omissions 


Demonstrates clear 
understanding of 
problem through 
inclusion of multiple 
perspectives and 
placement of problem 
in context 




Topic not a substantive 
one in the field 


Topic of documented 
educational importance 


Topic of documented 
educational 
importance, well 
justified 




Missing one or more of 
the following 
components: 
Introduction, rationale 
for the study, statement 
of the problem, general 
hypotheses and/or 
research questions, 
definition of terms 


All components 
included 


All components 
included and clearly 
described 
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Chapter 2 


Fewer than 15 sources 


15-20 sources 


More than 20 sources 




Includes only opinion 
and application articles 


Includes primarily 
research and synthesis 
articles 


Includes a variety of 
high quality sources, 
including articles from 
juried publications, 
interviews, - 
correspondence, etc.; 
emphasis on research 
and synthesis articles 




No clear organization 


Well organized 


Organization pattern 
demonstrates 
understanding of prior 
research on the topic 
(historical, general to 
specific, segments of 
the topics, etc.) 


Chapter 3 


Mismatch between 
research methods and 
questions/ 
hypotheses 


Uses accepted 
standards of research 
methodology 


Shows thorough 
understanding of 
research methodology 
used, including 
assumptions of 
statistical tests 




No limitations noted 


Limitations noted 


Thoughtful explanation 
of limitations and their 
justification 


Chapter 4 


Inaccurate or 
incomplete analysis 


Adequate analysis 


Insightful analysis and 
interpretation of data 




Lacks adequate 
narrative description of 
findings 


Includes adequate 
narrative description of 
findings 


Clear and complete 
narrative description of 
findings 




Lacks appropriate 
charts and/or tables 


Tables and charts . 
adequately support 
written research 
findings 


Tables and charts 
enhance written 
research findings 
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Chapter 5 


Lacks summary 


Summary adequately 
covers all components 
of project 


Clear, concise, and 
thorough summary; 
publication-quality 
abstract 




Lacks conclusion or 
conclusion not 
supported by the data 


Conclusions supported 
by the data 


Insightful conclusions, 
well supported by the 
data 




Lacks implications, or 
implications 
inconsistent with 
findings 


Includes relevant 
implications for 
educators 


Includes a variety of 
implications for relevant 
audiences: educators, 
students, parents, etc. 




Limitations not 
addressed 


Superficial treatment of 
limitations 


Insightful treatment of 
limitations 




Results not tied to 
literature review 


Results tied to literature 
review 


Results compared and 
contrasted with findings 
of prior researchers 




Lacks 

recommendations for 
future research, or 
recommendations are 
inconsistent with 
findings 


Recommendations for 
future research are 
consistent with 
research findings 


Thorough exploration of 
ideas for future 
research based on the 
research project 


Style/Organization 


Contains spelling and 
grammatical errors 


Contains no spelling or 
grammatical errors 


Contains no spelling or 
grammatical errors, 
demonstrates creative 
use of language 




Does not follow APA 
style 


Follows APA style 


Conscientiously follows 
APA style 




Lacks or uses 
quotations and/or 
citations ineffectively 


Uses quotations and 
citations appropriately 


Uses quotations and 
citations to enhance 
written narrative 




Includes sketchy 
descriptions 


Includes adequate 
descriptions 


Uses “thick description” 
where appropriate 




Organization plan 
inconsistent 

Does not maintain 
focus on research 
problem 


Organizational plan 
obvious throughout 


Organization plan 
enhances project 
presentation, promotes 
ease in reading 

Well written with 
smooth transitions 
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Muskingum College 
EDUC 700/701 
Research Project Rubric 



Score 


1 


3 


5 


Length 


Less than 20 pages 


20 to 30 pages 


More than 30 pages 


Chapter 1 


Mismatch between 
problem and research 
questions/ 
hypotheses 


Some relationship 
between problem and 
research questions/ 
hypotheses 


Clear relationship 
between problem and 
research questions/ 
hypotheses 




Superficial treatment of 
problem 


Adequate treatment of 
problem; no obvious 
omissions 


Demonstrates clear 
understanding of 
problem through 
inclusion of multiple 
perspectives and 
placement of problem 
in context 




Topic not a substantive 
one in the field 


Topic of documented 
educational importance 


Topic of documented 
educational 
importance, well 
justified 




Missing one or more of 
the following 
components: 
Introduction, rationale 
for the study, statement 
of the problem, general 
hypotheses and/or 
research questions, 
definition of terms 


All components 
included 


All components 
included and clearly 
described 
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Chapter 2 


Fewer than 15 sources 


15-20 sources 


More than 20 sources 




Includes only opinion 
and application articles 


Includes primarily 
research and synthesis 
articles 


Includes a variety of 
high quality sources, 
including articles from 
juried publications, 
interviews, 

correspondence, etc.; 
emphasis on research 
and synthesis articles 




No clear organization 


Well organized 


Organization pattern 
demonstrates 
understanding of prior 
research on the topic 
(historical, general to 
specific, segments of 
the topics, etc.) 


Chapter 3 


Mismatch between 
research methods and 
questions/ 
hypotheses 


Uses accepted 
standards of research 
methodology 


Shows thorough 
understanding of 
research methodology 
used, including 
assumptions of 
statistical tests 




No limitations noted 


Limitations noted 


Thoughtful explanation 
of limitations and their 
justification 


Chapter 4 


Inaccurate or 
incomplete analysis 


Adequate analysis 


Insightful analysis and 
interpretation of data 




Lacks adequate 
narrative description of 
findings 


Includes adequate 
narrative description of 
findings 


Clear and complete 
narrative description of 
findings 




Lacks appropriate 
charts and/or tables 


Tables and charts 
adequately support 
written research 
findings 


Tables and charts 
enhance written 
research findings 
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Chapter 5 


Lacks summary 


Summary adequately 
covers all components 
of project 


Clear, concise, and 
thorough summary; 
publication-quality 
abstract 




Lacks conclusion or 
conclusion not 
supported by the data 


Conclusions supported 
by the data 


Insightful conclusions, 
well supported by the 
data 




Lacks implications, or 
implications 
inconsistent with 
findings 


Includes relevant 
implications for 
educators 


Includes a variety of 
implications for relevant 
audiences: educators, 
students, parents, etc. 




Limitations not 
addressed 


Superficial treatment of 
limitations 


Insightful treatment of 
limitations 




Results not tied to 
literature review 


Results tied to literature 
review 


Results compared and 
contrasted with findings 
of prior researchers 




Lacks 

recommendations for 
future research, or 
recommendations are 
inconsistent with 
findings 


Recommendations for 
future research are 
consistent with 
research findings 


Thorough exploration of 
ideas for future 
research based on the 
research project 


Style/Organization 


Contains spelling and 
grammatical errors 


Contains no spelling or 
grammatical errors 


Contains no spelling or 
grammatical errors, 
demonstrates creative 
use of language 




Does not follow APA 
style 


Follows APA style 


Conscientiously follows 
APA style 




Lacks or uses 
quotations and/or 
citations ineffectively 


Uses quotations and 
citations appropriately 


Uses quotations and 
citations to enhance 
written narrative 




Includes sketchy 
descriptions 


Includes adequate 
descriptions 


Uses “thick description" 
where appropriate 




Organization plan 
inconsistent 

Does not maintain 
focus on research 
problem 


Organizational plan 
obvious throughout 


Organization plan 
enhances project 
presentation, promotes 
ease in reading 

Well written with 
smooth transitions 
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Educational Research 
Group Presentation Rubric 





0 points 


10 points 


20 points 


Length (x .5) 


< 5 minutes 


5 to 15 minutes 


About 20 minutes 


Participation (x .5) 


One person speaks, 
others stand around 


Two persons actively 
involved 


All members actively 
involved; speakers 
acknowledge 
contributions of group 
members 


Purpose of the Study 


Not stated; worthless 


Stated but unclear or 
vague 


Clearly stated; 
important, timely, 
interesting 


Literature Review 


Non-existent 


Another study 
mentioned 


Contributions from 
other studies (ideas, 
questions, instruments) 
stated and 
acknowledged 


Methodology 


Not linked to purpose; 
inappropriate 


Weakly linked to 
purpose 


Effective attempt to 
answer research 
question; may be 
primarily qualitative, 
quantitative, or mixed 


Results 


Ignored; unrelated to 
purpose or 
methodology 


Not clearly or 
thoroughly reported 


Clear and thorough 
reporting of findings; 
objective 


Discussion (x 1.5) 


Non-existent 


Not well related to 
results; analysis not 
thorough 


Conclusions and 
implications well 
supported by the data; 
implications useful for 
educators; suggestions 
for further research 


Audience Appeal 


Audience asleep at 
conclusion 


Most audience 
members able to pay 
attention throughout 


Audience members 
exhilarated by 
scintillating facts, 
stories, metaphor; 
outstanding 
audiovisuals 
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